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Abstract 

The Center for Mathematics and Sci¬ 
ence Education at Texas A&M Univer¬ 
sity contracted with Region 4 Education 
Service Center (ESC) and a large, di¬ 
verse school district to conduct a lon¬ 
gitudinal study from 2005 - 2009. The 
state achievement test scores of 5 th grad¬ 
ers who were taught using a Grade 5 
science textbook designed by Region 4 
ESC were analyzed in this study. While 
the text emphasized instruction via the 
5E Instructional Model, the study was 
undertaken to determine if sustained 
training and utilization of the texts by 
teachers and students changed the par¬ 
ticipating district’s science achievement 
gaps at Grade 5. The school district pro¬ 
vided their 5 th grade student state sci¬ 
ence achievement test scores. Baseline 
data were generated from 2004 - 2005 
scores and compared with scores from 
2005 - 2009. Descriptive statistics were 
used to determine group means, stan¬ 
dard deviations, and standard errors. 
Analysis of variance (ANOVA) tests 
were used to differentiate state science 
achievement group means by Test Ad¬ 
ministration Date, Gender and Ethnicity. 
Analysis of means by ethnicity revealed 
an observable achievement gap between 
White, African American, and Hispanic 
students. Science scale score means by 
ethnicity increased over the 5-year span. 
While significant 2 - way interactions 
were determined between Test Admin¬ 
istration Date and Gender, Test Admin¬ 
istration Date and Ethnicity, and Gender 
and Ethnicity, the effect for the inter¬ 
actions were all small. Thus the SMEs 
for the interactions were not provided. 
Overall, the district’s African American 
and Hispanic achievement gaps were 
greatly reduced, more so than the state 
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achievement gap during the same time 
period. 

Introduction 

In Rising Above the Gathering Storm 
(2007), the National Academies pointed 
to a lack of basic knowledge in science, 
technology and mathematics necessary 
for success in modern society. In re¬ 
sponse to this crisis in science literacy. 
Region 4 Education Service Center 
(ESC) created a textbook utilizing the 
5E Instructional Model and specifically 
addressing the state standards. At the 
beginning of the 2005-2006 academic 
year, the Center for Mathematics and 
Science Education at Texas A&M Uni¬ 
versity contracted with Region 4 ESC 
and a large, diverse school district serv¬ 
ing over 13,000 students to conduct a 
longitudinal study of the effectiveness of 
implementing the Grade 5 science text¬ 
book program. A five-year study (2005- 
2009) was conducted on high stakes 
achievement results of 5 th graders (from 
14 different elementary programs), 
who were taught using Region 4 ESC- 
designed textbooks. Teachers were trained 
by Region 4 curriculum specialists and 
student and teacher textbooks were fur¬ 
nished for each trained teacher’s science 
classroom. The science Texas Assess¬ 
ment of Knowledge and Skills (TAKS) 
provided the standard for measurement 
of student achievement, and scores of 
5 th grade students taught through the Re¬ 
gion 4 ESC-designed textbook program 
over the next four years were tracked to 
determine the impact of the program on 
student achievement. 

The 2004-2005 academic year served 
as the baseline, and the following re¬ 
search question guided this study: 

• How do 5 th grade science scores 
change as a result of the use of a 
textbook that utilizes the 5E 
Instructional Model? 


Background 

According to The Nation’s Report 
Card Science State Snapshot Report 
(NCES IES, 2009) for Texas Grade 4 
and Grade 8, students overall performed 
at a level not significantly different than 
the national average. However, African 
American, Hispanic, and low socioeco¬ 
nomic status (SES) students performed 
significantly lower than White students 
in Texas and around the nation. It was 
hoped that the newly created textbook 
program would improve all student 
scores and narrow the achievement gaps 
for African American, Hispanic, and low 
SES students. The district was chosen 
for the study because its demograph¬ 
ics mirror urban school settings where 
student achievement and achievement 
gaps between ethnic and socioeconomic 
groups are most critical. 

The Region 4 ESC textbook program is 
built on the state science curricular stan¬ 
dards, the Texas Essential Knowledge 
and Skills (TEKS), and is based on five 
guiding principles adapted from recom¬ 
mendations of the National Science Ed¬ 
ucation Standards (1996), Benchmarks 
for Science Literacy (1993), and other 
salient science education publications: 

1. Science is for all students; 

2. Learning science is an active pro¬ 
cess that includes both individual 
and social processing; 

3. Students must accept and share 
responsibility for their own 
learning; 

4. Teachers must consistently model 
the habits of mind necessary for 
scientific literacy, including 
values, attitudes, communication 
skills, and critical thinking; and 

5. Curriculum, instruction, and 
assessment must be specifically 
aligned. (McComber, McClane, 

& Mock, 2006, p. vii) 

The authors of the textbook strive to 
strike a balance in the topics covered and 
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Table 1: Summary for Numbers of Students in 
Each Year 


Year 

Total 5 th grade 
students 

Final* 5 th grade 
students 

2005** 

990 

928 

2006 

1052 

981 

2007 

1098 

983 

2008 

1161 

993 

2009 

1109 

1035 


Note: ‘Extracted duplicated students and Spanish 
test takers. 

“Baseline 


the depth of the science content learned, 
as recommended by DeBoer (2000). The 
teacher is afforded adequate instructional 
time for the necessary science concepts 
and process skills to be developed ef¬ 
fectively for student understanding. The 
Grade 5 science textbook has an instruc¬ 
tional plan that is vertically articulated, 
with knowledge and skills building on 
the previous year’s experiences to extend 
to a wider and deeper understanding of 
the same content. Instructional materials 
include 5E Model (Bybee et al., 2006) 
lessons and a wide variety of instructional 
strategies to teach core concepts and 
processes. A meta-analysis (Schroeder, 
Scott, Tolson, Huang, and Lee, 2007) of 
over 25 years of research of effective 
science instruction highlights many of 
the exemplary strategies utilized in the 
textbook, including contexualization, 
collaboration, hands-on learning, ques¬ 
tioning strategies, inquiry and assessment. 
Based on current literature about science 
reform, the 5E Model is very much aligned 
with best practices. Lessons are designed 
to fully develop math, problem-solving, 
reading and writing skills. Additional cur¬ 
ricular materials include mini-assessments 
aligned to the state standards, performance 
tasks and simulations of the state common 
assessment (Texas Assessment of Knowl¬ 
edge and Skills, also known as TAKS) 


for each grade level. In Texas, the state 
provides one common set of standards, 
the Texas Essential Knowledge and 
Skills (TEKS). Districts are free to use 
any curricula that address the standards. 

The 5E Instructional Model is based 
on a combination of Constructivist 
Learning Theory and Conceptual 
Change Learning Theory, accounting 
for the structure and organization of the 
Model (Bybee et al„ 2006). The orga¬ 
nization of the 5E Model systematizes 
academic content. The five phases of 
the instructional model are Engage, Ex¬ 
plore, Explain, Elaborate, and Evaluate. 
It is important to note that the teacher 
leads, models and facilitates throughout 
the lesson cycle. The curriculum guides 
the teacher through this process, prompt¬ 
ing them with facilitation questions and 
supplying background information. The 
approach is very much student centered 
and is more about discovery and deeper 
understanding than direct instruction. 
Students are introduced to academic 
content during the Engage component 
of the Model. This phase helps students 
to connect their previous learning expe¬ 
riences and background knowledge to 
newly presented content. Engage activi¬ 
ties may be question stems or activities 
such as discrepant events that elicit dis¬ 
cussion and focus student attention on 
an instructional goal. Student miscon¬ 
ceptions may be exposed, and students 
are actively motivated to engage in the 
learning. The following phase, Explore, 
requires interactive, hands-on activities 
designed to allow students to connect 
their observations and experiences to 
formulate concepts and skills. Follow¬ 
ing exploration is the Explain compo¬ 
nent, wherein students are allowed to 
discuss their observations and experi¬ 
ences. It requires students to reveal their 


Table 3:2005 - 2009 District 5 th Grade Average 
TAKS Science Scale Scores by Gender 


Group 

2005* 

2006 

2007 

2008 

2009 

Female 

Male 

2099 

2072 

2139 

2157 

2200 

2181 

2183 

2250 

2301“ 

2319 


Note: ‘Baseline 

“The average scale scores of ISD stu¬ 
dents exceeded the state-wide averages. 


observations, newly formed definitions, 
and understanding of the content. During 
the Explain phase, the teacher validates 
or re-teaches content and helps students 
connect their explanations to their expe¬ 
riences in the previous phases, while pro¬ 
viding scientific terms and explanations. 

The remaining phases of the 5E In¬ 
structional Model require students to 
apply their understanding of academic 
content. Elaboration, the fourth phase, 
contextualizes academic content. Stu¬ 
dents are able to experience how aca¬ 
demic content is used in the real world. 
The Elaboration experience facilitates 
concept transfer to new, but similar situ¬ 
ations and provides opportunities for 
further clarification and gathering of in¬ 
formation. During this phase, students 
interact within groups and have oppor¬ 
tunities to express their understandings 
and provide feedback to others. The 
Evaluation portion of the model assesses 
student understanding via formal assess¬ 
ments that may be performance based, 
objective questions, essays, or other 
types of summative assessments. Where¬ 
as informal formative assessment can be 
accomplished throughout the previous 
phases of the model, this phase provides 
the opportunity for the teacher to deter¬ 
mine educational outcomes. Within the 
final phases, students demonstrate their 
understanding and present evidence 
of how they have connected their new 
knowledge to previously learned experi¬ 
ences (Bybee et al., 2006). 

In a report on the 5E Instructional 
Model prepared for the Office of Sci¬ 
ence Education of the National Institutes 
of Health, Bybee et al., (2006) stated: 

The sustained use of an effective, 

research-based instructional model 

can help students learn fundamental 


Table 2: Descriptive Information for TAKS Science Scale Score for District 5 th Graders by Administration Date 


Administration Date 

Mean 

N 

Std. Deviation 

Std. Error of Mean 

April 2005* 

2085.40 

926 

436.151 

14.333 

April 2006 

2147.65 

970 

323.943 

10.401 

April 2007 

2190.73 

973 

314.695 

10.089 

April 2008 

2228.71 

993 

232.531 

7.379 

April 2009 

2309.76 

1035 

329.596 

8.441 

Total 

2195.14 

4897 

329.596 

4.710 


Note: ‘Baseline 
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Table 4: Frequency Information for Ethnicity for District 5 th Graders in 2005-2009 



Frequency 

Percent 

Cumulative Percent 

American Indian or Alaskan Native 

4 

.08 

.08 

Asian or Pacific Islander 

37 

.75 

.83 

African American 

1243 

25.30 

26.13 

Hispanic 

1961 

39.91 

66.04 

White, not of Hispanic Origin 

1669 

33.96 

100.0 

Total 

4914 

100.00 



concepts in science and other do¬ 
mains. If we accept that premise, 
then an instructional model must be 
effective, supported with relevant 
research and it must be implement¬ 
ed consistently and widely to have 
the desired effect on teaching and 
learning, (p. 1) 

Johnson, Kahle, and Fargo (2007) re¬ 
ported that sustained professional devel¬ 
opment programs have a positive impact 
on student achievement and suggested 
this type of program could help narrow 
achievement gaps in science. In an effort 
to ensure the consistent implementation 
of this model so it could realize the de¬ 
sired effect, trainers from Region 4 ESC 
met with science teachers for professional 
development on the textbook curricula at 
the beginning of each six weeks for the 
first year. 

The textbook program includes a 
teacher edition as well as a student edi¬ 
tion. The student edition organizes all 
lessons in the 5E Model sequence and 
requires students to keep a journal re¬ 
cording their observations, ideas, data 
collected, drawings, etc. The appendix 
to the student edition makes informa¬ 
tion and scoring rubrics available to the 
students for the learning strategies used 
throughout the lessons. The teacher edi¬ 
tion, in addition to the pages from the 
student edition, includes the information 


needed for implementation of each les¬ 
son. This includes materials lists, basic 
instructions for individual lessons, facili¬ 
tation questions with answers, additional 
ideas for implementation, and answer 
keys for the questions and activities. In 
addition, a Teacher Resource CD con¬ 
tains handouts and transparency masters, 
manipulatives, lab station cards, and as¬ 
sessment masters. Assessments include 
six Curriculum-Based Assessments and 
one TAKS-Based Assessment. 

Instructional strategies used in the 
textbook program are active and varied, 
helping students to develop a deeper un¬ 
derstanding of concepts. The curriculum 
facilitates changes in the instructional 
practice. While the lesson structure is 
consistently based on the 5E Model, the 
variety of strategies employed for vari¬ 
ous purposes helps motivate both teach¬ 
ers and students. Approaches used to 
activate prior knowledge include brain¬ 
storming and mental imagery and teach¬ 
ers are provided with organizational 
strategies and guidelines for implemen¬ 
tation. In order to create learner-centered 
instruction, strategies such as stations, 
cooperative learning, lab grouping, read 
and say something, and think-pair-share 
are employed. Strategies for organiz¬ 
ing information include concept map¬ 
ping, journaling, Venn diagrams and 
T-charts. Teachers are also encouraged 


to use physical models, simulations, and 
drawings to represent knowledge and 
processes and for students to make their 
thinking visible, thereby increasing their 
understanding. 

Data Analyses 

In order to address whether 5 th grade 
science scores changed as a result of use 
of a textbook that utilized the 5E Instruc¬ 
tional Model, the district provided TAKS 
data collected in April 2005, 2006, 2007, 
2008, and 2009. Information pertaining 
to 990 fifth graders in 2005, 1052 fifth 
graders in 2006, 1098 fifth graders in 
2007, 1161 fifth graders in 2008, and 
1109 fifth graders in 2009 was obtained. 
Duplicate data files (repeat 5 th graders) in 
the five data sets and those students who 
took the Spanish version of the TAKS 
test were extracted, resulting in final data 
sets of 928, 981, 983, 993 and 1035, re¬ 
spectively (Table 1). This 5-year data set 
served as the input for the analyses. 

Science Scale Score was used as the 
dependent variable (DV); the indepen¬ 
dent variables (IVs) were administration 
date, gender, and ethnicity. In some of 
the analyses, the numbers of observa¬ 
tions do not match those of the final data 
set because of missing values in terms of 
IVs. Because of the large sample sizes, 
the impact of the missing values was 
judged to be minimal. 

Administration Date 

Data were first analyzed in terms of 
the administration dates. The descrip¬ 
tive portion of the analysis for Admin¬ 
istration Date is summarized in Table 2. 
The average performance of the district 
5 th grade students increased across the 
five years. The difference in mean scale 
score from the base year of 2005 to 2009 


Table 5:2005 - 2009 District 5 th Grade Average 
TAKS Science Scale Scores by Ethnicity 


Group 

2005* 

2006 

2007 

2008 

2009 

All 

2085 

2148 

2191 

2218 

2310 

AA 

1922 

1995 

2018 

2107 

2209 

H 

2062 

2124 

2153 

2190 

2288 

W 

2229 

2273 

2350 

2345 

2421 


Table 6:2005 - 2009 State and District 5 lh Grade Average TAKS Science Scale Scores by Ethnicity 


Group 

2005* 

2006 

2007 

2008 

2009 

State 

ISD 

State 

ISD 

State 

ISD 

State 

ISD 

State 

ISD 

All 

2176 

2085 

2202 

2148 

2221 

2191 

2280 

2218 

2322 

2310 

AA 

2071 

1922 

2109 

1995 

2159 

2018 

2187 

2107 

2234 

2209 

H 

2114 

2062 

2152 

2124 

2230 

2153 

2230 

2190 

2270 

2288** 

W 

2270 

2229 

2285 

2273 

2341 

2350* 

2368 

2345 

2414 

2421“ 


Note: AA = African American; H = Hispanic; 
W = White. 

‘Baseline 


Note: AA = African American; H = Hispanic; W = White. 

‘Baseline 

“The average scale scores of district students exceeded the state-wide averages. 
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Table 7: Summary ANOVA for District 5 th Grade TAKS Science Scale Score for Administration 
Date, Gender and Ethnicity 

Dependent Variable: TAKS Science Scale Score 


Source 

Type III Sum of 
Squares 

df 

Mean Square 

F 

P 

Partial Eta 
Squared 

AdminDate 

30022203.3 

4 

7505550.839 

82.450 

.001* 

.064 

Gender 

96239.399 

1 

96239.399 

1.057 

.304 

.001 

Ethnicity 

53608863.6 

2 

2.6805E7 

294.452 

.001* 

.109 

AdminDate x Gender 

913655.655 

4 

228413.914 

2.509 

.040* 

.002 

AdminDate x Ethnicity 

1548520.778 

8 

193565.097 

2.126 

.030* 

.004 

Gender x Ethnicity 

1424261.087 

2 

712130.544 

7.823 

.001* 

.003 

AdminDate x Gender x Ethnicity 

742249.483 

8 

92781.185 

1.019 

.419 

.002 

Error 

439319010.556 

4826 

91031.705 





Note: Adjusted R Squared = .162 

American Indian or Alaskan Native and Asian or Pacific Islander were not included in this analysis. 
* Significant @ p < .05 


represents an increase of 224, translating 
to a 10.8% increase. The results of the 
post hoc test indicate there were statis¬ 
tically significant differences among the 
administration dates. This result suggests 
5 th grade students who received science 
instruction via the texts in 2006-2009 
outperformed 5 th grade students who 
received science instruction without the 
texts in 2005. The average performances 
of the 2006-2009 5th graders were sig¬ 
nificantly different from each other. Di¬ 
rect cause and effect cannot be applied 
to these differences because the science 
abilities of the four groups could have 
been different before the intervention of 
the project. However, implementation of 
the texts contributed to increased student 
achievement. 

Gender 

For the years 2005-2009, the average 
performance of females and males was 
very similar (Table 3), indicating no 
gender bias in the TAKS Science Scale 
Scores of the district 5 th graders. Except 


for the slight decline for females from 
2007 to 2008, both groups demonstrated 
improved performance across the time 
periods. District 5 th grade females expe¬ 
rienced a 9.62% increase from the base 
year of 2005 to 2009. The 5 th grade male 
students achieved an 11.92% increase 
during the same time span. 

Ethnicity 

Analysis of the means by ethnicity re¬ 
vealed an observable achievement gap 
for three ethnic groups. The descriptive 
information and the percentages of the 
various ethnic groups are displayed in 
Table 4. Among district 5 th graders exam¬ 
ined in the years 2005 to 2009, the ma¬ 
jority of students were Hispanic (1,961), 
followed by Whites (1,699) and African 
Americans (1,243). These three ethnic 
groups comprised over 99% of the stu¬ 
dents in the 5 th grade. Since the numbers 
of students in the ethnicity categories of 
American Indian or Alaskan Native and 
Asian or Pacific Islander were too small 
to warrant statistical inference, these two 


groups were not included in the subse¬ 
quent analysis of variance (ANOVA) 
tests involving ethnicity. The achieve¬ 
ment gap for the three analyzed ethnic 
groups may be seen in Table 5. 

The science scale score averages for 
the three major ethnic groups rose over 
the five-year study for both the state and 
district (Table 6). The district’s African 
American students’ average scores in¬ 
creased by 287 points (14.93%) while 
Texas African American students’ av¬ 
erage scores increased by 163 points 
(7.87%). In the same time span, district 
Hispanic students’ average scores in¬ 
creased by 226 points (10.96%) and the 
scores of their counterparts in the state 
increased by 156 points (7.38%). Dis¬ 
trict White students’ average scores in¬ 
creased by 192 points (8.61%) and Texas 
White students’ average scores increased 
by 144 points (6.34%). 

ANOVA 

Differences in group means were ana¬ 
lyzed using a between groups 5x2x3 
(Administration Date x Gender x Eth¬ 
nicity) ANOVA. A summary of the 
ANOVA results is presented in Table 7. 
There was not a significant 3-way in¬ 
teraction of the I Vs. Significant 2-way 
interactions were obtained between Ad¬ 
ministration Date and Gender, between 
Administration Date and Ethnicity, and 
between Gender and Ethnicity. The main 
effects for Administration Date and Eth¬ 
nicity were both significant and were 
probed because the effect sizes associated 
with the significant 2-way interactions 
were all judged to be extremely small. 

Since the 2-way interactions were not 
explored, we examined main effects us¬ 
ing Ryan-Einot-Gabriel-Welsch F test. 
The results of the post hoc test indicate 
that there were statistically significant 
differences among the administration 
dates (Table 8). This result suggests 
that the average Science Scale Score of 
5 th grade students who received science 
instruction with the 5E-based textbook 
in 2006-2009 outperformed 5 th grade 
students who received science instruc¬ 
tion with a more traditional textbook 
and curricular model in 2005 (base¬ 
line). The average performances of the 


Table 8: Post Hoc Results for Administration Date for BISD 5 th Grade TAKS Science Scale Score Ryan- 
Einot-Gabriel-Welsch F 


Administration Date 

N 



Subset 



1 

2 

3 

4 

5 

April 2005* 

919 

2085.06 





April 2006 

962 


2146.43 




April 2007 

963 



2188.21 



April 2008 

988 




2281.41 


April 2009 

1024 





2309.83 


Note. Means for groups in homogenous subsets are displayed. 
‘Baseline 


52 


Science Educator 











Table 9: Cross-tabulation of District 5th Grade Administration Date by Percent Met Standard 





Did not meet 
standard 

Did meet 
standard 

Texas students 
met standards 

Total 

Admin Date 

2005* 

Count 

362 

564 


926 



% within Administration Date 

39.1% 

60.9% 

64.0% 

100.0% 



% of column total 

26.7% 

15.9% 


18.9% 


2006 

Count 

292 

678 


970 



% within Administration Date 

30.1% 

69.9% 

75.0% 

100.0% 



% of column total 

21.5% 

19.1% 


19.8% 


2007 

Count 

293 

680 


973 



% within Administration Date 

30.1% 

69.9% 

77.0% 

100.0% 



% of column total 

21.6% 

19.2% 


19.9% 


2008 

Count 

238 

755 


993 



% within Administration Date 

24.0% 

76.0% 

81.0% 

100.0% 



% of column total 

17.6% 

21.3% 


20.3% 


2009 

Count 

171 

864 


1035 



% within Administration Date 

16.5% 

83.5% 

84.0% 

100% 



% of column total 

12.6% 

24.4% 


21.1% 

Total 


Count 

1356 

3541 


4897 



% within Administration Date 

27.7% 

72.3% 


100.0% 



% of column total 

100.0% 

100.0% 


100.0% 


Note: ‘Baseline 


2006-2009 5 th graders were judged to be 
significantly different from each oth¬ 
er. Direct cause and effect cannot be 
applied to these differences because 
the science abilities of the four groups 
may have been different. However, the 
cross-sectional longitudinal data may be 
used to indicate that the 5E Model cur¬ 
riculum has to be considered a major part 
of the change. 

Secondary Analyses for Percent 
Met Standard 

Percent Met Standard by 
Administration Date 

The percent of 5 th graders surpassing 
the panel recommended score of 2100 
was calculated for the IV of administra¬ 
tion date (Table 9). Since the basis upon 
which the percentages were calculated 
changed across time, a comparison be¬ 
tween and within years and/or groups 
needs to be undertaken with caution. The 


required score to “meet state standards” 
increased from year-to-year, the number 
of schools tested year-to-year changed 
and there was a large influx of Hispanic 
students over the study period. As may 
be seen from Table 10, the percent of dis¬ 
trict 5 th grade students who met the state 
science scale score standard increased 
from 2005 to 2009. 

Percent Met Standard by Gender 

The percent met standard analyses 
were carried out for gender at each of the 
administration dates. The cross-tabulations 
summary is presented in Table 10. 

Summary 

In this fourth-year evaluation of the 
effectiveness of the Grade 5 science 
textbook program, the differences in 
the TAKS Science Scale Scores of 5 th 
grade students in the district for the 
years of 2005, 2006, 2007, 2008, and 
2009 were investigated. The 5 th graders 
in 2005 received science instruction via 


Table 10: Summary of District 5 th Grade Percent Met Standard by Gender 

GENDER 


Adm. Date 

Female 

Male 

Total 

2005* 

60.2% 

61.6% 

60.9% 

2006 

69.1% 

70.7% 

69.9% 

2007 

70.3% 

69.5% 

69.9% 

2008 

71.9% 

79.7% 

76.0% 

2009 

81.5% 

85.4% 

83.5% 

Change in Percent 2005-2009 

21.3% 

23.8% 

22.6% 

Note. ‘Baseline 


the state-adopted traditional textbook 
and the 2006 through 2009 5 th graders 
received science instruction via the Re¬ 
gion 4 ESC-designed textbook program. 
While there were statistically significant 
differences in the average performance 
across the five data sets, complete inter¬ 
nal validity cannot yet be assigned to the 
Region 4 ESC-designed textbook pro¬ 
gram. A comparison of the average per¬ 
formance of the 2006 5 th graders when 
they were retested as 8 th graders in 2009 
would have provided some insight into 
the longitudinal effect of Region 4 ESC- 
designed textbook usage in the district. 
However, since the TAKS Science tests 
for these two grades are different in both 
number of items and difficulty level, 
such a comparison would need to be 
viewed with caution and was therefore 
not presented. 

Within this fourth-year data analysis 
of the district 5 th grade students, there is 
an indication that the science achieve¬ 
ment gap between the three major ethnic 
groups still exists. There is not a gap in 
terms of gender. The results pertaining to 
the percent met standard data mirrored 
the increases seen in terms of science 
scale score. The base number for White 
students remained relatively stable across 
the time periods and the absolute number 
of White students who met or surpassed 
the standard increased. This resulted in an 
increase in percent met standard for this 
group. Since the base number for Hispanic 
5 th graders substantially increased and 
the absolute number of students meeting 
the standard also increased substantially, 
this translated into a large change in the 
percent who met the standard, especially 
from 2007 to 2008. Since the number of 
African American students decreased, 
then increased, and then decreased again, 
the percent met standard fluctuated in the 
same pattern for this group. 

Conclusions 

Due to lack of access to the state data¬ 
base and removing repeaters and Span¬ 
ish test takers, as was done with students 
in this study, statistical comparisons can¬ 
not be made. It should be noted that the 
usual effect of repeat examinations re¬ 
sults in higher scale scores. 
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Table 11: Differences between District 5 th Grade and State 5 th Grade Average TAKS Science Scale Scores by Ethnicity 


ETHNICITY 


Yr. 

African American 


Hispanic 



White 


Entire Population 

ISD 

TXAvg. 

Diff. 

ISD 

TXAvg. 

Diff. 

ISD 

TXAvg. 

Diff. 

ISD 

TXAvg. 

Diff. 

‘05* 

1922 

2071 

-149 

2062 

2114 

-52 

2229 

2270 

-41 

2085 

2176 

-91 

‘06 

1995 

2109 

-114 

2124 

2152 

-28 

2273 

2285 

-12 

2148 

2202 

-54 

‘07 

2018 

2159 

-141 

2153 

2230 

-77 

2350 s 

2341 

+9 

2191 

2221 

-30 

‘08 

2107 

2187 

-80 

2190 

2230 

-40 

2345 

2368 

-23 

2218 

2280 

-62 

‘09 

2209 

2234 

-25 

2288 s 

2270 

+18 

2421 s 

2414 

+7 

2310 

2322 

-12 


Note: ‘Baseline 

s The average scale scores of district students exceeded the state-wide averages. 


The percent change of scale scores 
for all groups examined rose higher for 
district students than their state counter¬ 
parts (Table 11 and Table 12). Admit¬ 
tedly, state scores were initially higher in 
the baseline year and a capping phenom¬ 
enon likely occurred. The average scale 
score for all students, African Americans 
and males were higher for all Texas stu¬ 
dents compared to district students. This 
was true in the baseline of the study in 
2005 and remained so throughout the 
following five years. However, Hispan- 
ics. Whites and females from the district, 
all of whom had lower average scale 
scores than their counterparts at the state 
level in 2005, outscored them by the end 
of the study. 

Achievement gaps between African 
Americans and Whites and Hispanics 
and Whites were analyzed. In the base¬ 
line year (2005), achievement gaps in 
the district were 1.54 - 1.07 times higher 
than the state achievement gaps for Afri¬ 
can Americans and Hispanics, in terms 
of scale score (Table 6). At the close of 
the study, the district African American 
achievement gap was still higher than 


the state average. However, the gap had 
been reduced by 31.0% over 4 years in 
the district and the respective gap for the 
state had been reduced only by 9.5%. 
The Hispanic achievement gap for the 
district students was reduced by 20.4% 
over the study as compared to 7.7% in 
the state. It is also important to note that 
the Hispanics in the district had a lower 
achievement gap (133 points) compared 
to their White counterparts than did Tex¬ 
as students (144 points). 

The final comparisons were conducted 
to examine the percentage of students 
who met the state standard of proficien¬ 
cy, deemed to be a scale score of 2100 
points. All groups examined showed an 
increase in the average number of stu¬ 
dents meeting the minimum standard 
(Table 13). A close examination reveals 
the district and state students meet¬ 
ing standards rose approximately at the 
same rate based on baseline and final 
data results. 

Discussion 

The curriculum based on the 5E model 
showed promise for some groups that 


have been less successful in science and 
historically underrepresented in the sci¬ 
ence, technology, engineering and math¬ 
ematics (STEM) professions, namely 
Hispanics and females. Comments from 
teachers and science specialists in the 
district about the first draft of the text 
commented on its merit, but also sug¬ 
gested novice teachers struggled with 
implementation. There were not enough 
examples for teachers who lacked con¬ 
tent knowledge or were new to the class¬ 
room. A limitation of this study was 
that teachers at the respective schools 
changed over time and new teachers did 
not receive the same amount of training 
in the use of the 5E Model. With this 
feedback and due to updated state stan¬ 
dards, the Region 4 ESC has now written 
a newer edition. Also, it is difficult, if not 
impossible to determine the consistency 
and level of adoption and implementa¬ 
tion of the text and principles throughout 
the district. While the persistent achieve¬ 
ment gap among African Americans is 
troubling, the fact that approximately 
74% of the population of the district 
(Hispanic and Whites) overtook their 


Table 12: Differences between District 5 th Grade and State 5 th Grade Average TAKS Science Scale Scores by Gender 






GENDER 




Entire Population 



Male 



Female 


ISD 

TXAvg. 

Diff. 

ISD 

TXAvg. 

Diff. 

ISD 

TXAvg. 

Diff. 

‘05* 

2072 

2198 

-126 

2099 

2154 

-55 

2085 

2176 

-91 

‘06 

2157 

2220 

-63 

2139 

2184 

-45 

2148 

2202 

-54 

‘07 

2181 

2297 

-116 

2200 

2246 

-46 

2191 

2221 

-30 

‘08 

2250 

2311 

-61 

2183 

2250 

-67 

2218 

2280 

-62 

‘09 

2319 

2353 

-34 

2301 s 

2229 

+72 

2310 

2322 

-12 


Note: ‘Baseline 

8 The average scale scores of district students exceeded the state-wide averages. 
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Table 13: Difference between District 5 th Grade Percent Met Standard and State 5 th Grade Percent Met Standard by Ethnicity 


Adm. Date 





ETHNICITY 





Total Percent 
Passing 


African American 



Hispanic 



White 


District 

State Average 

Difference 

District 

State Average 

Difference 

District 

State Average 

Difference 

‘05* 

42.0% 

46.0% 

-4.0% 

57.1% 

54.0% 

+3.1% 

78.4% 

79.0% 

-0.6% 

60.9% 

‘06 

48.7% 

59.0% 

-10.3% 

64.1% 

67.0% 

-2.9% 

89.0% 

88.0% 

+1.0% 

69.5% 

‘07 

47.4% 

64.0% 

-16.6% 

64.7% 

70.0% 

-5.3% 

91.0% 

90.0% 

+1.0% 

69.9% 

‘08 

60.8% 

69.0% 

-8.2% 

73.0% 

76.0% 

-3.0% 

91.7% 

91.0% 

+0.7% 

76.0% 

‘09 

70.8% 

75.0% 

-4.2% 

83.4% 

80.0% 

+3.4% 

94.1% 

93.0% 

+1.1% 

83.5% 

Chg. ’05-‘09 

28.8% 

29.0% 

-.2% 

26.3% 

26.0% 

+.3% 

15.7% 

14.0% 

+1.7% 

22.6% 


Note: Total includes American Indian or Alaskan Native and Asian or Pacific Islander. 
‘Baseline 


state counterparts over the 4 year study 
is a powerful testimony to the efficacy 
of the text incorporating the 5E model 
in student engagement and learning in a 
high stakes test environment. 
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